OracleonNutanix(SETraining)
AlbertChen
APACSystemSpecialistEngineerBusinessCriticalApps
SolutionArchitect
2
Albert Chen / Nutanix APJ System Specialist -BCA
§ Certification
ITILv2;HPUXSystemAdministrator;OracleOCP;
VMwareVCP3, 4,5;EMCTechnologyArchitectExpert;
EMCCACloudArchitectSpecialist,NutanixNPP
Certification,TTTCertification
§ Experience
NutanixAPJSr.SystemEngineer2014 ~ Now
VMwareGlobalCOE–Sr.SolutionArchitect2011
EMCsolutionCenterPrincipleSolutionEngineer2004
HPService–SoftwareEngineer2001
SystexTechnicalEngineer1997
3
What are Business Critical Applications
Any application that could have a material impact on your or your
customers organizations' reputation, productivity or financial
viability if it were to become unavailable or experience severe
performance degradation for an extended period of time
Examples:
§ ERP systems and supporting databases and middleware
§ Manufacturing, Process Automation and Control Systems – SCADA
§ Financial systems, payment processing, online banking
§ Middleware and ESB systems
§ Billing systems
§ Customer facing online systems
§ What else?
4
Generally
Hardware or software refresh
Uptime and compliance issues
Mergers or rapid business transformation
Exchange
Exchange 2010 upgrade cycle (no in-place upgrade
from either 2003 or 2007)
Issues with DAG or clustering
SQL
SQL version upgrade (e.g. 2005, 2008, 2012)
Changing Microsoft licensing from Enterprise to
Datacenter
SharePoint
SharePoint version upgrade (e.g. 2007 to 2010)
Migration from other collaboration
platforms/applications
Oracle
Creating cost-effective development and testing environments
quickly
Underutilized Oracle database servers that need consolidation
SAP
New SAP install
SAP upgrade cycle
Migration to 64-bit NetWeaver
New SAP modules (e.g. CRM, BW, SCM)
Unix Migration
Cost-cutting or end of mainframe lease
Changing database platform (e.g. DB2 to Oracle)
Java
Scalability issues (e.g. parallelism or data latency)
Application downtime due to frequent software and system
upgrades
When to Virtualize that App?
5
BusinessCriticalApplicationHighAvailability
ProtectonCPU/Memory–
ServersClustering–Protectonservicelevel
HypervisorClustering–ProtectonVMlevel
ProtectonStorage–
DualController/DualFans/DualPDU
RAID1/5/6
HighAvailabilityalwaysmentionedRTO,RTOdecideyourdesign
ApplicationLevel–ex:OracleRAC(RTO<fewseconds)
OSLevel–ex:VeritasCluster(RTO<13minutes)
HypervisorLevel–ex:vSphere,AHV(RTO<35minutes)
6
FieldPresales“asks”onOracledatabase
CustomerrequiredsizingOraclefortheirenvironment,buthow?
HaveaPOCrelatedtoOracledatabase,butdon’tknowwhatkindof
modelNutanixcanfitin?
HowmanyOracledatabasesinonenodewillbethebestconsolidation
rate?
HowrunningabestpracticedesignedOracledatabaseonNutanix?
Whatkindoftoolsforperformancetesting?
POCtestingstep&Scenarios?
7
Oracle101
WearenottrainingeveryoneasaOracleDBA.Wejustgive
youideaaboutwhatthedatabasedoing,andwhatweneed
toknowrelatedtoNutanix
Ifyouwantknowmore,youcanjointheirofficialtrainingor
moreselfstudy
8
Instance
OracleBasicInfrastructure
Storagestructures
Memorystructures
Processstructures
SystemGlobalArea(SGA)
Backgroundprocesses
Databasefiles
ClientProcesses
BufferCache
Share_
Pool
Data
Dirctionary
Large
Pool
9
OracleInstance/Database
Instance
- SGA+BGProcesses
- SGA
Buffercache–Likeour“OPLOG”and“ContentCache”forwrite/readcacheusage
SharePool–SQLhashstore
DataDictionary–SystemObjectcache–like“MetaDataCache”forafilesystem
LargePool–forexport/import,backup
- PGA:Processesworkingspace
Database
- Agroupoffiles,WhererelatedtoIO
10
Whatkindofdatafiles?andfunctions
Onlineredologfiles
Passwordfile
Parameterfile
Archivelogfiles
Controlfiles
Datafiles
Alertandtracelogfiles
Tempfiles
Group1
Group2
Group3
11
OracleFiles
ControlfilesLogallOracleStructure(Howmanydatafiles,locations..)sometime
forbackupcataloguse
Datafiles–Wherethetables,indexesinside
Redolog–Wherelogalltheinsert,update,deletetransactionrecord
Archivelog–Whenenabledarchivemode,willstartgenerate.Oldredologcopy
Parameterfileplaintextorbinfiles(bydefaultafter9i),keepallparameter(ex:
SGAsize,Parallel..)
TempfileWhensortingorjoinSQLstatementwillsave
Alert/Tracelog–systemlog,findproblemuse
12
WhatrelatedtoNutanixIO?
ControlfilesAlwaysreadwhenstartdatabase,writewhenbackup.Whendesign
wecanignorethelocationofthis.
Datafile–
- Traditionalway,wewillaskseparatetablesandindexestablespacesintotwoLUNs.Best
practicenowusingASM.Willintroducelater
- OLTPalwaysrandomread/write,IOsizeusually8kbutcanchangeafter9i
Redolog–Alwayssequencewritenoanyread.Butwhenenablearchivelog,will
startsequenceread.
Archivelog–Alwayssequencewrite,Whenrecoverdatabase,startsequenceread
13
Logicalvs.PhysicalviewinOracle
Database
Logical Physical
Tablespace
Datafile
OSblock
Segment
Extent
Oracledata
block
Schema
RealFiles
8,16,32K
YoucanthinkSchemaisauser
Thinkisasatable/Indexusedspace
14
Oracle
ASM
TheOperationalStack
Disks
LogicalVol
FileSystem
00100010001000100010
00100010001000100010
Files
Tablespace
Tables
DiskGroup
LogicalVol
FileSystem
Files
Tablespace
Tables
OLDUNIXOracleDB
ASM
15
ASMBenefits
What’sASM
SpecialOracledatabaseinstance–StillaOracledatabase…..(YoucanthinklikeCVM)
LikeVxVMvolumemanager
Benefit
Simplifiedmanagementinterfaceforstorageresources
EliminatesmanualI/Operformancetuningtasks
Virtualizesthestoragetoasetofdiskgroups
Providesmainframeclassperformanceatlowercost
What’sthedifferentcompareASMwithVxVM/LVM?
KeyisASMwillloadbalanceontablespacelevel,VxVMorLVMnotjustPE(PhysicalExtent)level
16
OracleBackup/Restore
17
BackupMethod
PhysicalDataProtection
Coldbackup–shutdownalldatabase,copyallfilestootherlocation(impossibletocustomer)
Export/ImportorDataPump–Justbackuppointintimedata
HotBackup–UsingRMANbackuputilitytoTapeorDisk(Mostofuserwillusethisasabackup
methodofOracle)
VMwareVADP(VMwarevStorageAPIforDataProtection)
LogicalDataProtection
Flashback–CanprotectinTransaction/Table/Wholedatabaselevel
Needtoassign“FastRecoverArea”
Likesnapshot…recovertopointintimewhendodatabaselevelrecover
18
RMANBackup
RMAN–
- UsuallyusingcontrolfileoracatalogDBasabackupmetadb(oryoucanthinkitasIndex).
- Supportalldatabasebackup,incrementalbackup(Blockchangetrace)
- MostofthirdpartybackupsoftwarecallRMANscripttobackupOracleDB(Backupagent
issuescripts)
ALLOCATECHANNELch00TYPE'SBT_TAPE’;
- Clonedatabaseonlinefordeveloporfordataguard
19
OracleDatabaseTraditionalInfrastructureLayout
OracleRACLUN
1TBx12
OracleRAC
VMDK
500GBX24
ESXiDatastore
1TBX12
OracleASMDG1
1TB
(redolog,temp
tablespace,controlfiles)
OracleArchiveLogDest
500GBperVM
OracleASMDG2
500GBx20=10TB
(tabledatafiles,index
datafiles)
YoustillneedtodecideLUNsRAIDType,ZoningandMasking
KeyQuestiontocustomer
HowmanyLUN/Datastorenow
youneedtomaintain?
Imageonedatabasewith10LUNsyou
have10database,youneedmaintain
100LUN,40Zoning,100masking
Ifdatabaserunoutspace,addextra
storageforspace…Complicate,Risk....
20
OracleDatabaseNutanixLayout–OurKeyBenefit
Container
OracleRAC
VMDK
500GBX24
Datastore
OracleASMDG1
1TB
(redolog,temp
tablespace,controlfiles)
OracleASMDG2
OracleASMDG3
500GBx20=10TB
(tabledatafiles,index
datafiles)
Noneedtodesign
KeyAnswertocustomers
Reducemaintaineffort
Easytoextendspacewithoutdesign
andrisk
AutomaticLoadbalanced
21
OracleRAC
ESXiHost1
ESXiHost2
VM
Oracle
RAC1
VM
Oracle
RAC2
Oracle
VMDK
(Shared)
EnableMultiwriter
DesignKeyNote
MultiWritermustenabled(ESXi)
ThickEagerZeroformatforVMDK(ESXi)
Interconnectenablejumboframe
Interconnectusingvlan
LeverageDRSaffinityrules
AlwaysdesignasN+1
22
YourRTOdecideyourdesign
NX8235G4
NX3360G4
ESXi/AHV ESXi/AHV ESXi/AHV ESXi/AHV
ESXi/AHV
VM
RAC1
VM
RAC2
VM
Oracle
VM
Oracle
VM
Oracle
Tier1Oracledatabase
Tier2/3Oracledatabase
OralceStandardEdition
RTO310minitus
OralceEnterpriseEditionwithRAC
RTO<1minutes
OracleRAC1&RAC2usingESXiDRS
AffinitylockinNX8235G4
Hypervisor
Tier2/3OracleusingESXiDRS
AffinitylockinNX3360G4
23
TraditionalITScalingMethod
100KIOPS
Performance
BusinessincreaseRequiredmoreservers
TheIOPSwillbecome200K?
DataMigration/Risk
24
NutanixScalingMethod
NDFS NDFS
VM
Oracle
vMotionwithoutdowntime
Nodatamigration
Norisks!!
25
DatabasePerformanceonNutanix
25
26
DatabasePerformanceonNutanix
26
27
NutanixABSScalesasyourBusinessGrows
CVM
CVM
CVM
New Node
CVM
Applicationneed90KIOPS
Whenbusinessgrowth
Applicationneed120KIOPS
28
OracleLinux/OracleVMsupportNutanixABS
29
What’sthedifferentfromtraditionaliSCSIstorage
TraditionaliSCSI
Providelimitedstoragecontroller
usuallyistwo
Needconfiguremultiplepathand
assigncontrollers’ports
TraditionalRAID–Whendisk
failedrebuildslow
AddmoreLUNs,youneed
manualassignwhichcontrolleras
primaryandwhichissecondary
NutanixABS
Provideunlimitedscaleoutstorage
controller(Performancecanscaleout)
SingleDataServiceIP,donotneedto
assigntoeachcontrolleriSCSItargetport
Distributedatatoothernodesprovide
RF=2,3protection.Ifnodefailed,westill
haveonecopyontheothernode
Addmorevdisk,automaticloadbalance
inthebackend
30
HowtoperformaefficiencyPOC
31
What’sthesuccessfulcriteriaforanOraclePOC
EngageProcesses–
What’sthecustomer’sexpectation?Ex:Ineedachieve4000TPS
Testingobjectives(HA,Functional,orPerformance)?
HowlongforthisPOC?POCisnotQC.
DowehaveabaselinecomparewiththisPOC?Comparewitholdsystemorsome
standardtestingtool?
Whatweneedavoid–
Usingwrongtestingtools–Ex:Storagevendersprovidedscript,singleSQLstatement,
batchjobexecutetime
AskingforDataremodeling(Tablerepartition),DBA&Developersjobs
AskingforSQLstatementreenforcement(RewriteSQL),DBA&Developersjobs
Tables/Index/StoreProcedure..Storageobjectreconfigure
32
What’sthesuccessfulcriteriaforanOraclePOC
Whatweneedprepared?
- Schedule,milestone,ownership
- Leverageapplications’venderssupport–Engageyourresources.Wecan’tdoeverything
- Correctsizing–ChoosetherightmodelforPOC.(Keyitem)
- Choosingrighttestingtools–Fair,QuicksetupPOCenvironment
- KeepPOCsimple–MostofdatabasePOCiscomplex,ifweinvolvetoomanydatabase
internalobjectlikeTables/Index/Procedure,SQLstatement…Wewillmakethingscomplex
- OLTP&OLAPtestingconfigurationaredifferent.Pleaseaskcustomerwhatkindoftesting
theywant
- Getthecurrentsysteminformationaspossible.Ex:OracleyouneedgetAWRreportif
possible.
33
WhatOracle/SQL/Mysqlperformancetoolsweuse?
NutanixprovideXRayforOLTP&OLAPtestingWetalklater
Oracle–
BenchmarkFactoryhttp://software.dell.com/products/benchmarkfactory/need$$$
**Swingbenchhttp://dominicgiles.com/swingbench.html(no$$$)
HammerDB
SQLServer
BenchmarkFactory
HammerDB
SQLIO,Dskspeed(I/Oonly)
MySQLServer
Sysbench
HammerDB
BenchmarkFactory
34
X-Ray 2.0
MusthaveNutanixloginaccount
Downloadfromthe“Tools&Firmware
35
How to download X-Ray source
DownloadHere
Ifyoucan’tdownload,
pleaseaskfromyourregionchannelSE
36
Create X-Ray VM
ActuallyXRayisaovaorqcowfile
Youcanuseimageserviceuploadtoyour
Cluster.
Afterupload,youcancreateaXRayVM
Note:
RecommendinstallthisVM
outsidethetestingcluster
37
Test Scenario
UsingBrowserconnectto
http://yourxrayipaddress
38
Choose Hybrid/ All Flash Scenario
Whenchoosescenario,
Pleaseselecttheright
TestingmodelHybridor
Allflash
39
Add Target
IntheCreateTarget,meansaddatestingclusterinXRay
Choosethetypeofmanager,andclustertype.Givetheright
Informationasrequired
40
Result Analysis
AfterrunningXRay,itwillgivearesultanalysisandalsoshowyoutheperformanceresult
41
Result Analysis
Youcanexporttestingresultasazip
Orcreateareportforreading
42
OracleSizingandDesign
43
Correctsizingisveryimportant
DBAs
InfrastructureTeamMembers
Whenyousizingwronginthebeginning
Thenyouneedalltheexpertshelpyou
ButwemaynotrescueyoubecauseIt’s
Overload!!!
Customers
Physicalnodes
CustomerDatabase
44
CurrentStatusofOracleSizing
WehaveSizeronNutanixwebsite–It’sthestandardof
Nutanixsizingmethodology
https://services.nutanix.com
SizerhadalreadycoveredmostofapplicationsbutnotOracle
database
WeleverageSizer“Raw”inputmethodforsizingOracle
database
InthefuturewillbehaveOraclesizingscenario
45
OracleSizingProcess
Collectperformance
datafromcustomer
site
AnalysisPerformance
WeatherReport
CPUConversion
MemoryCalculation/
IOPS/WSS
Assumption
SizerRAWdataInput
ConsideringHA/CPU
core/SDD
Conservative
ReportGeneration
PushBOMtoSFDC
VMlayoutonnodes
46
Collectperformancedatafromcustomersite
ConnectHQVPN,andlogintoMurali’sOracleAWRAnalyzer
Website
http://10.20.13.52:8080/RProject/index.html
47
Collectperformancedatafromcustomersite
Step1
RequestthecustomertoruntheAWRCaptureSQLtocapturethedata.Runthese
onallDatabasesinscopeforsizing(atleastProductiondatabases).Scriptis
herecapture_awr_stats.sql
Step2
Uploadtheoutputfileineitherawrhist*.outformatorazipfileformat(incaseof
multiplefiles).Sample.outfilecanbefoundhereawr-hist-2505896440-PPTL1-
7424-7627.out (Corp VPN is needed)
Step3-NutanixSE
OnceyouuploadthefiletheparserwillparsetheoutputandgenerateaPDF
outputwhichyoucanuseforsizing.ItalsogeneratesanOverallSummary.csvin
caseyouareparsingmultipleoutputfilesatonce.SamplePDFhereAEBPD01-
40055-40852-1-plot.pdf
48
CollectionStep1
IfcustomerDBAcanhelpyoutocollectthatwillbegood,butif
customerdon’tknowhow,Pleasefollowthissteptocollect
data
1. Loginassysdbaordbaprivilege
Loginoracleuser,inthecommandprompttype=>sqlplus/assysdbaorsqlplus
system/PASSWORD@SID
sqlplus>@capture_awr_stats.sql(willrequireDiagnosticPacklics)askfor
customerdotheyhavethis.
Inthesamefolder,willhaveoneoutoutlike“awrhist1423744458ORCL0
155.out”,where14237xxxxisDBID,ORCLisoracleinstance
49
Collection–Step2
Selectfilesanduploadawrhistxxx.outfile
Clickupload&parse
50
Collection–Step3
DownloadthePDFfile
51
AnalysisPerformanceWeatherReport(Section1)
52
AnalysisPerformanceWeatherReport(Section1)
Keymessages
Node6meansOracleRACdatabase
Platform–Linux
Version11.2.0.3(patchesupdate3)
Socket/coretotal12sockets/96cores,meansonenodewith16core(Wejust
watchingcorenumbers)
Threads192means–Hyperthreadsenabled
Memory256GBpernode–Totalmemoryofthismachineuse(notSGA)
Daysshown28.8days–totalcollectAWRtimeis28.8days
53
AnalysisPerformanceWeatherReport(Section1)
Keymessages
CPUMaximum98.1/Averageis41.5(Section2cansee)
SGA+PGA=258+51=309GB,51pernode
Databasesize=13624GB
54
AnalysisPerformanceWeatherReport(Section2)
55
AnalysisPerformanceWeatherReport(Section2)
Keymessages
Rednumberforaveragevalues–CPU41.5average,ReadIOPS47782,WriteIOPS
4999.6
Read/WriteRatio–47782/4999.6=9.5:1(OLAPdatabasepossible,butweneed
section3asaevidence)
MaximumReadIOPS=89571,MaximumWriteIOPS=7872(Wewillbaseonit
whenwesizing)
56
AnalysisPerformanceWeatherReport(Section3)
57
AnalysisPerformanceWeatherReport(Section3)
Keymessages
Watchdailyoperationbehavior
WriteisregularlythroughMondaytoFriday,andduringtheworkinghours
Readispeakatnight,andhappendailyeveninSaturdayandSunday
ThisdatabasecouldbeaOLTPandinnightwillbeaOLAPbehavior
58
CPUConversion
Scenario–
CustomerI
AlreadyuseX86serversbutstillinphysical
AlreadyuseX86servers&virtualization
WeuseSPEC2006
CustomerII
UsingoldUNIXserver,andwantconvertintovirtualization
WeuseSAPs
Reasonis,youcan’taskusertobuyaoldmachinetocompareUnixCPUtoIntelCPUhead
tohead.Wejustusethe3
rd
partydatatocalculate
59
Customer I – Using SPEC CPU 2006
TheSPECCPU™2006benchmarkisSPEC'snextgeneration,
industrystandardized,CPUintensivebenchmarksuite,stressing
asystem'sprocessor,memorysubsystemandcompiler.
https://www.spec.org/cpu2006/results/cint2006.html
60
CustomerI–UsingSPECCPU2006
Example:
ForthisOracleRACcustomerusingDellPowerEdgeR720IntelXeonE52603v21.8GHzCPU.The
Resultis29.4forsingletaskCPUperformance

ForNX8035G4,wepickSuperMicrowithsameCPUtype.IntelXeonE52660v3,TheResultis60.7
or60.8forsingletaskCPUperformance
Sotherelativecomparisonwillbe60.8/29.4=2.06.ItmeansE52660v3almosttwicespeedsofE5
2603v2.
Ifcustomerconvertfromphysicaltovirtual,therewillbeaoverheadforhypervisor.Wealways
assumeas10%ofthisconversionlost.Itmeans2.06X0.9=1.86.
61
Customer II – Using SAPs as calculation
TheSAPApplicationPerformanceStandard,knownasSAPSisa
unitofmeasurementthatdescribestheperformanceofaSAP
systemconfiguration.
http://global.sap.com/solutions/benchmark/sd2tier.epx
62
Example:
CustomeruseOracle10grunningonsolarisSPARC,UltraSPARCT2Pluswith32cores.TotalSAPSis
25830.Thenwecancalculatepercoreis25830/32=807SAPs.
NowCustomerwantrunningonNX8150E52697v2CPU,theaverageSAPsis53702.EveryE52697
v2CPUhave24core,percoresapis53702/24=2237

DuetoVirtualizationwillhaveoverheadtoCPU,2237x0.9=2013.
ThewecanassumeoneIntelE52697CPUequaltoUltraSPARC=2.49:1
CustomerII–UsingSAPsascalculation
63
Assumption
Assumption
ThismaynotgiveyouapreciselynumberoftheCPUconversionvalue.Butcan
giveyouarelativevaluebetweenthoseCPUmodel.
WhenusingSAPstocalculate,weignorethebackenddatabasetype.
AlltheSAPstestingisusing99%ofCPUutilization,Customer’sactual
utilizationwon’tnotsohigh.Ifwecangetcustomers’currentCPUutilization
calculation,thecalculationwillmoreprecisely.
IfSAPscan’tfindaCPUtypelikeE52697v2,wecanpickoldonelikeE52660
v2andusingSPEC2006togetrelativecomparisonvalue
**NotallCPUmodelcanbefoundinbothSPEC2006andSAPwebsite.Ifyou
can’tfindoneexactly.Choosethemostsimilarone
64
WSSCalculationorAssumptionRules
Calculation
Choosethemaximumdeltasetx3asaWSS
Assumption
ForOLTPworkloads(<5TB)assume50%oftheDBsizeasworkingsetandincreaseto100%
dependingonhowbusythedatabaseis
ForDWworkloads(>5TBSize)assume20%workingsetandincreasethenumberbasedon
customerdiscovery
65
IOPSCalculation
UsingtheMaximumIOPSwecollectfromourscript(obsolete)
WSS(WorkingSetSize)isthemostimportantinformationweneedtoget,but
inourscriptwecan’tgetthis
WSSwilldecidetheSSDsizeinyourNutanixmodel
InsomestoragelikeEMCVNX,VMAXcantrackingdeltablockchanged
Ex:VNX–ReservedLUNPoolsusage
***WeassumedWSSforOLTPis30%ofalldatabase
66
Oursizingexample
CPUcoretotal=96
AssumeuseruseoldE52603andweconverttoE52660v2
TotalIOPS=ReadIO(Max)+WriteIO(Max)
89571+7872=97443IOPS
Totalcapacity1.3TBdatabaseusage(NotincludeVMGuestOSusage).
TotalRAM=1151GBbyguesthosts,SGA+PGA=309GB
WeassumetheOLTPWSSis30%,So13TBdatabasedata,wehave3.9TB
WWS.Actuallycolddatawillbe133.9=9.1TB
67
LogintoNutanixSizerandusingRAWasWorkloadType
68
InputScenarioaswecollect
FromAWRanalysis
FromE52603toE52660v2
Shouldbeshrinkinourcase
Hot+ColdData
Recommendfordatabase
69
ChoosingRF,ErasureCoding
70
Createadedicatedclusterfortheworkload
71
Noprotectionconfigureinthiscase
72
Configuration1–Automatic
TCOcostsaving71%
73
Configuration2Manual
TCOcostsaving72%
74
Configuration3NX8035G5
TCOcostsaving72%
75
Whichconfigurationisthebestone?
FromROI/TCOperspective
Configuration2&3savemoremoney
FromHAperspective–
Configuration1&2whenoneofthenodefailed,canprovidebetterresource
Spendmoremoneyonlicensefee
FromPerformanceperspective
Configuration3providebestperformance(NUMAandlargeSSDspacetohold
moreWSS)
ForAutomaticConfigurationisnotrecommendtouseinthis
scenario,weneedtobacktochecktheCPUconversionratio
76
BestPracticeforBusinessCriticalApplicationImportant
NutanixLayer
HypervisorLayer
GuestOSLayer
ApplicationLayer
WhenimplementBestPracticeforapplication
***Weneedtocheckalllayerconfiguration&
Parameterfollowbestpractice
Responsetime
77
Read the Best Practice then applied
BeforeBestPracticeApply AfterBestPracticeApply
Insamenode,Before&After
78
Design your critical database like “Partition”
2Socketwith40cores
192GBRAM
CVM
4cores/16GB
App1
8cores/32GB
App2
8cores/32GB
App3
16cores/96GB
App4
4cores/16GB
DedicateCPUcore/MemoryforT1Database
Dev/Testingcanbeovercommit
PhysicalMachine
79
VM1
ORACLE
CPUNUMAAlignementdesigninHypervisor
NutanixNode–2sockets,12physicalcores
vCPU-6
vCPU-3
VM2
ORACLE
VM3
ORACLE
vCPU-3
vCPU
vCPU
vCPU
vCPU
vCPU
vCPU
vCPU
vCPU
vCPU
vCPU
vCPU
vCPU
1
Socket1(6cores)
C
C
C
C C
C
1
Socket2(6cores)
C
C
C
C C
C
80
CPUNUMARemoteAccess
Memory CPU CPU Memory
MemoryCtrl
MemoryCtrl
Interconnect MemoryChannelMemoryChannel
LocalAccess RemoteAccess
81
CPU/NUMABestPractices
AvoidRemoteNUMAaccess
Size#ofvCPUstobe<=the#ofcoresonaNUMAnode(processorsocket)
AlwayskeepHyperthreadson
Initialconservativesizing:setvCPUsto#ofcores
HTbenefitaround2025%insomescenarios
IncreasevCPUstogetHTbenefit,butconsider“numa.vcpu.preferHT”option–
individualcasebasis
DisableHotAddCPU
AlignmentVMsvCPUwithinphysicalNUMAboundariesifpossible
82
MemorySizing
PGA
(Client sessions and context)
Oracle SGA
(DB buffer cache, and others)
Operating System
VMConfiguredMemory
WhenwerunOracledatabaseinvirtualizationenvironment,weneedrightsizingofthoseVM
andreservedRAMforOracleDB
SGA+PGA+BackgroundProcess+OS=ThatisreservationRAMsize
Keep1:1rulesforOracle/SQLdatabase
Reservation
VM
83
SGA/PGAsizeforanewproject
OLTP DSS(OLAP)
SGA_TARGET=(total_mem*0.8)*0.8,where
total_memisthetotalamountofphysical
memoryavailableonthesystem
SGA_TARGET=(total_mem*0.8)*0.5,where
total_memisthetotalamountofphysical
memoryavailableonthesystem
PGA_AGGREGATE_TARGET=(total_mem*0.8)
*0.2,wheretotal_memisthetotalamountof
physicalmemoryavailableonthesystem
PGA_AGGREGATE_TARGET=(total_mem*0.8)
*0.5,wheretotal_memisthetotalamountof
physicalmemoryavailableonthesystem
84
MemorySizingfromtheAWRreportExistSystem
85
Running AWR report
SQLPLUS> @?/rdbms/admin/awrrpt.sql
86
VirtualMemoryBestPractices
ESXiMemoryManagementMechanisms
PageSharing,Ballooning,MemoryCompression,SwaptoHostCache,RegularHostLevelSwapping
MemoryReservation(ESXiOnly)
AHVnomemoryovercommit
setmemoryreservation=allocatedmemory(avoidballooning/swapping)
useactivememorycounterwithcautionandalwaysconfirmedusagebycheckingmemorycounterinPerfmon
DonotdisableBalloondriver,TransparentPageSharing(TPS)
andMemoryCompression(ESXiOnly)
VMwareToolsmustinstalledintheguestOS
Ifpossible,buylargeRAMmodelofNutanixtokeeptheconsolidationratio
higher
87
ASMLayoutforESXi
VM
PVSCSI
PVSCSI
PVSCSI
PVSCSI
vDISK1 vDISK2
vDISK3
vDISK4
vDISK5
vDISK6
vDISK7
vDISK8
VMwarePVSCSI
DiskGroup1
(Datafiles)
DiskGroup2
(RedoLog)
DiskGroup3
(ArchiveLog)
NDFS
88
ASMLayoutforAHV
VM
vDISK1 vDISK2
vDISK3
vDISK4
vDISK5
vDISK6
vDISK7
vDISK8
Virtio
DiskGroup1
(Datafiles)
DiskGroup2
(RedoLog)
DiskGroup3
(ArchiveLog)
NDFS
VirtualSCSI
89
ThinorThickinvDisk?
Wealwaysthinkthe“Thick”isbetterperformance?
https://blogs.vmware.com/vsphere/2014/05/thickvsthindisksflash
arrays.html
Notmuchinperformance
OnlyneedwhenyouconfigureOracleRAC
Butyouneedthink“SSD”isexpensivethan“HardDrive”
Soyouneedsaveyour$$thincansaveyourspace
NutanixAHValwaysinthinmode
Nutanixalsoprovidecompression,savemore!
90
91
92
93
94
95
OracleRACusingVMDKmultiwriterorusingABS
WhenyouuseOracleRAConNutanix
InESXi,youhavetwooptions.UsingVMware“multiwriter”parameterinyour
vDisk
OrYoucanuseNutanixABSconfigure(iSCSIconnection)
InAHV,youcanuseABS(Directconnection)or(iSCSIconnection)
Whichoneperformanceisbetter?
96
OracleLayerBestPractice
ConfigureOracleInitializationParameterParallel_Threads_per_CPU=1,and
DB_File_MultiBlock_Read_Count=128
DisableOracleAMMAutomaticMemoryManagement
SGA/PGAcorrectsizing
UtilizemultipledisksforRedoLog,ArchiveLog,DatabaseTableSpaces
UseOracleAutomaticStorageManagementifpossible,andsettheAUsize=1M
EnableAutoExtendasafailsafeandsetnextsizetobeamultipleoftheASMAU
ScalenumberofORADBVMsvs.largenumberofORADBinstancesandschemasperVM
UseJumboFramesforOracleRACInterconnectNetworks
UseVLAN’stoseparateOracleRACInterconnectTraffic
97
LinuxLayerBestPractice
ReduceSwapping,usinghugepage,modifytheI/Oelevatorinthekernelbootparameter
Go/etc/sysctl.confaddfewlineintheendofthisfile
vm.overcommit_memory=1
vm.dirty_background_ratio=5
vm.dirty_ratio=15
vm.dirty_expire_centisecs=500
vm.dirty_writeback_centisecs=100
vm.swappiness=0
Aftermodifyalltheparameter,gocommandprompttype=>sysctl–p,rereadthesysctl.confand
takeeffective
Alsofollowbestpracticeedit/etc/security/limit.conf
NetworkingTuninginGuestOS(ESXionly)
UsingESXiVMXNET3vNICandInstallVMwaretools
Executecommand>/sbin/ethtoolGethXrx4096tx4096(Only)
98
HypervisorLayerBestPractice
ClusterDesignusingN+1,nomatterESXiorAHV
IfusepercentagevalueforHAadmissioncontrol=1/HostsperCluster(vSpherenoly)
Ex:if4nodesincluster,setHAadmissioncontrol=25%
KeeppCoretovCPU1:1forTier1,sometimescanbe1:2,dependsonyourdatabaseloading
KeepNUMArule–KeepvCPUnumberseasilydivisiblebyNUMAnodesizesforeasyscheduling
MemoryreservationfromHypervisorlevel(VMwareonly),AHVwillreserved
VDSuseRouteBasedonPhysicalNICLoad,VSSRouteBasedonVirtualPortID(VMwareOnly)
UsingPVSCSIandVMXNET3
ESXiAdvanceparameter–
NFS.ReceiveBufferSize=512
NFS.SendBufferSize=512
Net.TCPIPHeapMax=512
UsingThickEagerZerodiskwhenOracleRACinconfiguration
99
Storage Best Practices
Use multiple PVSCSI adapters to evenly distribute target devices
Format database VMDK files as Eager Zeroed Thick for demanding
workload database
Follow same guidelines as physical
Separate vmdk with different IO characteristics i.e. datafile, log files, temporary
Using Oracle ASM , otherwise make sure datafile size equally and load
balance them
Disable Nutanix Shadow Clone Function
Enable Container Level Compression
Sizing Working set size correctly
100
UsingNutanixABSforOracleDB
iSCSIparametermusttune
node.session.cmds_max=2048
node.session.queue_depth=1024
node.session.iscsi.ImmediateData=Yes
node.session.iscsi.FirstBurstLength=1048576
node.session.iscsi.MaxBurstLength=16776192
node.conn[0].iscsi.MaxRecvDataSegmentLength=1048576
discovery.sendtargets.iscsi.MaxRecvDataSegmentLength=1048576
101
NetworkBestPractices
SeparateinfrastructuretrafficfromVMtrafficforsecurityandisolation
Using10Gb/sConnection
Separatenetworkadaptersfor
vMotion
FTloggingtraffic
ESXiconsoleaccessmanagement
iSCSIusinginGuestiSCSI(SQL2008FCI)
UseNICLoadbasedteamingfor(ESXionlyEnt+&VDS)
UseVMXNET3Paravirtualizedadapterdriverstoincreaseperformance
(VMwaretoolsneeded)
102
NutanixLayerBestPractice
UseasingleRF=2container
KeepworkingsetinSSDanddatabasesizewithinnodecapacity
ActiveWorkingSet=DatabaseBlocksReadPerDay+Database
BlocksChangedPerDay
UtilizehighermemorynodemodelsforI/OheavyORADBworkloads
KeepmostupdateNOSversion
Alwaysturnoncompression(inlinecompression)
Donotuseerasurecode,anddeduplication
103
InlineCompressionperformance
Pleasereadthesearticle,wroteandtestbyJoshOdgers
http://www.joshodgers.com/2017/08/02/thetruthaboutstoragebenchmarking/
http://www.joshodgers.com/2017/02/15/whatistheperformanceimpactoverheadsofinlinecompressionon
nutanix/
104
Best Practice to Leverage
Oracle on Nutanix Papers
Oracle Solution Brief
Virtualizing Oracle with Web Scale Solution Note
Oracle on Nutanix Best Practices Guide
Oracle on AHV Best Practice Guide
Microsoft SQL Server on Nutanix Papers
Microsoft SQL Server Solution Brief
Virtualizing SQL Server on HCI Solution Note
Microsoft SQL Server on Nutanix Best Practices
Pleasecheckhere–
http://www.nutanix.com/search/best+practice
105
MigrationOracletoNutanix
106
HypervisorSupportonNutanix–Oracle
Hypervisor GuestOSSupported Remarks/Notes
OnlyOracleLinux
107
DatabasemigrationScenario
TypeI:UnixServertoNutanixPlatform(Oracle)
RecreateOracledatabaseonNutanixPlatform
Offline:DataPump
NearOnline:OracleGoldenGate,DataGuard(OraclePlatformneedtocheck)
TypeII:PhysicalX86toNutanixPlatform(Oracle,SQL)
RecreateOracledatabaseonNutanixPlatform(Bestway)
Offline:DataPump,VMwareConverter(NoneedrecreateVM),SQL Export/Import
NearOnline:OracleGoldenGate,DataGuard(OraclePlatformneedtocheck) , SQL Mirroring
TypeIII:ESXiX86toNutanixPlatformwith(Oracle/SQLonESXiServer)
RecreateOracledatabaseonNutanixPlatform(Bestway)
Offline:DataPump,NearOnline:OracleGoldenGate,DataGuard(OraclePlatformneedtocheck),StoragevMotion
TypeIV:ESXiX86toNutanixPlatformwith(AcropolisHyperVisor)
RecreateOracledatabaseonNutanixPlatform(Bestway)
Offline:DataPump,NearOnline:OracleGoldenGate,DataGuard(OraclePlatformneedtocheck),StoragevMotion
108
OracleDRsolutiononNutanix
109
NutanixDRSolution(VMLevel)
DataCenterA
DataCenterB
ClusterA ClusterB
ESXiHost1
ESXiHost2
ESXiHost3
ESXiHost4
Oracle
VMDK
Oracle
VMDK
Replicated1hr/async
Primary Secondary
Cluster1
VM
Oracle
VM
Oracle
ProtectionGroup
Cluster2
110
NutanixDR(VMLevel)
Requirements
- TwoNutanixClusterineachsite,networkconnected
- Networkspeedwillinfectthesynchronizationschedule
- TwovCenterServersinbothsite
Advantage
- SimpleconfigurationusingNutanixPrismandprovideVMlevelprotection
- SeamlessintegratedwithvSphereEnvironment
- NoanyOracleskillinvolve
- Provideblocklevelchange/compress/encryptiontransmit
- SynchronizationisdonebyNutanix,notvSphere
- Disadvantage
- TheRPOistoolongfordatabasesolution(1hr)
- DRbootupsequenceneedbescriptorbySRMintegrated
111
NutanixDRSolution(VMLevel–SRM)
DataCenterA
DataCenterB
ClusterA ClusterB
ESXiHost1
ESXiHost2
ESXiHost3
ESXiHost4
Oracle
VMDK
Oracle
VMDK
Replicated15mins/async
Primary Secondary
Cluster1
VM
Oracle
VM
Oracle
vSphereReplication
Cluster2
SRM
SRM
112
NutanixDR(VMLevelSRM)
Requirements
- Canbedifferentstoragesineachsite,networkconnected
- Networkspeedwillinfectthesynchronizationschedule
- TwovCenterServersinbothsite
Advantage
- SeamlessintegratedwithvSphereEnvironment
- NoanyOracleskillinvolve
- Provideblocklevelchange/compress/encryptiontransmit
- TheRPOis(15minutes–minimumto1day),dependsonOracleSLAinTruecorp
- DRbootupsequenceintegratedbySRM
- SupportHeterogeneousStorageenvironment
- ProvideVMlevelprotectionifusingvSphereReplication
Disadvantage
- SynchronizationisdonebyvSphere,notNutanix–meanstakeserver’sCPUcycle
- ComplexconfigurationinvSphereReplication(vSphereReplication,SRM,vCentersettings)
113
OracleHighAvailability&DisasterRecovery(cont’d)
Primary
Database
Standby
Database
SYNCorASYNCRedoShipping
UsingOracleNet
q OracleDataGuard
Providesdataavailabilityandprotectioninasimple,fast,and
reliableonewayreplication
FordatacenterDR
DGisnotintendedtobeafullfeaturedreplicationsolution
OracleGoldenGateistherecommendedsolutionforadvanced
replicationrequirementssuchasmultimasterreplication,granular
replicationofasubsetofadatabaseandmore
CanbePhysicalorLogical
Physicalstandbyisanexactblockforblockcopyofaprimary
database.UsesRedoApplyinwhichredodatareceivedfroma
primarydatabaseiscontinuouslyappliedtoaphysicalstandbyusing
databaserecoverymechanisms.
Logicalstandbyisinitiallycreatedasanidenticalcopyoftheprimary
databasebutlatercanbealteredtohaveadifferentstructure.
Appliesinfofromarchived/redologsbytransformingthedatainthe
logfilesintoSQLstatementsandthenexecutingSQLstatementson
thelogicaldatabase.Canbeusedforqueriesandreportingatany
time.
AdditionalcostforOraclelicenses
114
OracleHighAvailability&DisasterRecovery(cont’d)
UNIDIRECTIONAL
ReportingInstance
q OracleGoldenGate
Enablesthecontinuous,realtimecapture,routing,
transformation,anddeliveryoftransactionaldataacross
heterogeneousenvironments.
$$$
BI-DIRECTIONAL
InstantFailover
“Active-Active”
PEER-TO-PEER
LoadBalancing
HighAvailability
BROADCAST
DataDistribution
CONSOLIDATION
DataWarehouse/Mart/Store
CASCADINIG
Scalability,DatabaseTiering
117
PerformanceTroubleshooting
118
DatabaseResourcesConsumption
CPU Memory
Disk Network
Threads–Single,Multiple
ControlI/O,Netowork
IOPSOLTP
MB/sOLAP
BufferCacheData–HitRatio
CacheSQLcodeRepeatUse
SortArea
ClientConnectionWorkArea
SupportClientConnectionNumberofConnections
ReplicationAAG,DataGuard…
InternConnect–RAC
119
Slow–youcanfeel
WhenyouimproveyourCPUperformance
by100%Canyoufeelthat?No….
ButWhenyouimproveyourDiskIOperformance
by100%Youwillfeelit.
Ex:IhaveaHomePC,IupgradetheCPUmodel
orIreplaceanewSSDfromoldHDD?
Whatyouwillfeelworth?
120
DatabasePerformanceIssue(forSystemlevel)
Findwhatyourapplicationconsume?
CPU,Memory
DiskIO
Network
Database(wewillnotcoverthislevel,that’sDBAshoulddothis!
Datastructure(Table/Index)
SQLstatement(Optimization,parse,executingplan)
Databasewaits,lock,latch.
Whencustomersaid–Myperformanceslow….What’sthefirstto
investigate?Answer:DiskIO
121
IdentifySingleThreadActivities
IfSinglethreadYounevergetmoreIOPS.Howweidentifieditsa
singlethreadIO?
DDisaverycommonexamplewhencustomerdoingperformancetest
CheckNFSSlave“Avgoutstanding”
https://portal.nutanix.com/#page/kbs/details?targetId=kA0600000008hMOCAY
OrinWindowstaskmanager,youalwayssee
122
Windowstaskmanager
SingleThreadRunningin
WindowsTaskManager
123
StargateComponentsAccess
FrontendAdapter(iSCSI/NFS)
AdmissionControl
vDiskController
ExtentStore
Oplog
ExtentCache(Nodedupe)
ContentCache(Dedupe)
StargateComponent
124
StargateComponents
FrontendAdapter
Receivesread/writerequestsfromthehypervisorhost
AdmissionControl
DetermineswhichrequeststoforwardtovDiskcontrollers,basedonthetypeofrequestand
numberofoutstandingrequestsinthepipeline
vDiskController
RespondstoincomingrequestsbasedonwhetheritisrandomorsequentialRandomIOissentto
theoplog.SequentialIOissenttotheextentstore.
Oplog
Receivesrandomwriterequests,whicharecopiedtoanoplogonanothernodeforhighavailability
125
StargateComponents
ExtentStore
Respondstorequestsbyreadingandwritingtothephysicaldisksonthenodeandsendsa
copytoanextentstoreonanothernodeforhighavailability
ExtentCache(nodedupe)
Holdsacopyofthemostrecentlyreturnedreadrequestsforcontainersconfiguredwithout
FingerprintonWrite(dedup)
Theextentcacheisstoredinmemory.
ContentCache(dedupe)
HoldsacopyofthemostrecentlyreturnedreadrequestsforcontainersconifiguredwithFingerprint
onWrite(dedup)
Thecontentcacheisstoredinmemoryandthemetadatadrive.
126
WhatweneedtocheckinstorageI/O?
Youneedtoinvestigatethosefirst–
What’smydatabasesize?DomydatabasedataalwaysonSSD?
CheckfromprismSeeifyourdatamostoftimeisinSSD
Atleast50%ormoredatashouldbeonSSDex:youhave2TBdatabasebuyyoujustuse2x480GBSSD
nodetosupportit?
Dowehaveenoughwritecache?
NutanixusingOPLOGaswritecache–before4.5weusepervDisk2GBOPLOGlimitation,after4.6wehave
onevDisk6GBOPLOGlimitation.
Checkfromprismport2009(stargatepage)seeifOPLOGfull.IfOPLOGfull,youneedaddmorevDisk
IfaddmorevDisks,OPLOGstillfull.Youcanconsiderproposeallflashmodel.
127
WhatweneedtocheckinstorageI/O?
Youneedtoinvestigatethosefirst–
CPUwaitIOtimeishigh?
AlwaysCPUshouldbespendtimeforprocessapplicationnotforsystem%andwait%
Using“Taskmanager”inWindowsor“Glances”,“Sar”..InLinuxtoidentiy
WhereisheavyIOsource?Whoisthetroublemaker?
SomebadSQLstatementconsumealltheIO?
CreatesomeindextohelpreduceIOrequirement?
ChecktheSQLexecutionplan?(MayneedDBAsupport)
128
WhatweneedtocheckinstorageI/O?
Dowehaveenoughqueue?
Whenmultipleconnections,oryoujusthaveonevDiskfordataaccessing,youalwaysgetthis
issue
Alwaysyouwillseelatencyhigher
CheckthequeuefromOSfirst,Hypervisorlevel,Storagelevel
129
StartOplogMonitoring
TwomethodtocheckOplogusage
Enableport2009iniptables
- Shouldbeopennormally
- Ifnotopenport,pleaseusefollowcommendinCVM
- foriin`svmips`;dossh$i"sudoiptablestfilterAWORLDLISTptcpmtcpdport2009j
ACCEPT&&sudoiptablessave";done
- Connecttohttp://CVM:2009
collect_perfthenuploadtoilluminatiAnalysisServer
130
Oplogmonitoring
ChecktheOplogSize
Before4.5oplogis2GB,afterNOS4.5oplogsizeperdiskis6GB
Check“oplog”size,ifconsistencykeepinmaximum.Separatetomorevdisk.
Avglatency(usec)alsoneedtocheck
SomeGflagcantune
stargate_prioritize_drain_on_oplog_pct_left=80(default35)
stargate_vdisk_max_op_delay_secs=0(default5)
131
Oplogusagepage
132
ExtentCacheHitRatio
http://CVM:2009/cache_stats
AlwayskeepCacheHit%Higher
Ifhitratioislow,increaseCVMmemorysize
133
ExtentStore
It’sgoodplacetocheckdataisdraintoHDD
IfmoreactivitiesarelocateintheHDD
SSDcan’tholdthedataoverflow
Sequentialwrite(Ops/sWritewillmore)
Datanotinextentcache(Ops/sReadwillmore)
134
Sometimesyouneedcheckbackenddiskresponsetime
Slowdiskresponse
135
CheckallvDiskLatencyRange
Ifyourresponsetimeisbetween2~20ms,justlikeatraditionalstorage
Ifyourresponsetimeismorethan50ms,customershouldbefeltslowresponseinapp
Weshouldbekeeptheapplicationbelow1ms,thenyourcustomerwillbeveryhappy
136
ChecktheaveragelatencyforavDisk
Mostoftime,thisshouldbenearFrontEndwritelatency
Ifyoufindthisnotmatchtofrontendwritelatency,youshouldcallsupporttocheck
137
Checkwherethedataislocate
BestCaseshouldbefromthis
138
OraclePerformance&Troubleshooting(cont’d)
qAWRReports
o Showsperformancedatacapturedbetweentwosnapshots
o Reportsaveragesstatisticsoverthetimeperiodbeinganalyzed
o Defaultsnapshotsarehourly
o Forperformancetroubleshooting,snapshotshouldbearound15minutesto30
minutesduringpeaktimeortroubletime
o Musthaveabaselinetocompareagainst
o Fortransactionaldatabase,latencyisthemostimportantfactor
o Foranalyticaldatabase,throughputisthemostimportantfactor
139
OraclePerformance&Troubleshooting(cont’d)
q AnalyzingAWRReports
o Thingstolookfor
140
OraclePerformance&Troubleshooting(cont’d)
q AverageActiveSessions
o ThenumberofconcurrentsessionsthataredoingSQLor
PL/SQLstatements
o Thiswillgiveagoodindicationofhowbusythedatabase
isduringthatsnapshotperiod
o AAS=DBtime/ElapsedTime
o 160/5=32activesessions
o 24000/120=200activesessions
141
OraclePerformance&Troubleshooting(cont’d)
q LoadProfileSection
o Thissectiongivesanindicationoftheredosize(inbytes)
duringthesnapshotperiod.
o TheRedoSizeshowshowmuchredohasbeengenerated.
o Transactionsshowshowmanytransactionspersecond
thedatabasehasgeneratedduringthesnapshotperiod.
142
OraclePerformance&Troubleshooting(cont’d)
q IOProfileSection
o ThissectiongivesanindicationofthephysicalIORequest
o TotalPhysicalIOs=50199.6
o PhysicalRead%=38443.9/50199.6*100=76.6%
o PhysicalWrite%=11755.7/50199.6*100=23.4%
143
OraclePerformance&Troubleshooting(cont’d)
q ForegroundWaitClassSection
Lookforthe“UserI/O”and“SystemI/O”waitclassandthe%valueinthe“%DBtime”column.Thisis
the%ofDBtimethatwasspentwaitingonI/O.Alsolookatthe“Avgwait(ms)”columnforthosewait
classes.
UserI/OWaitWaitsforuserI/O(ex:‘dbfilesequentialread’)
SystemI/OWait–WaitsforbackgroundprocessI/O(ex:DBWRwaitfor‘dbfileparallelwrite’)
144
OraclePerformance&Troubleshooting(cont’d)
q Top10ForegroundEventsSection
LookforEventswithhigh%DBTime
Dbfilesequentialread–RandomI/Osingleblockreadfromdisk(89%DBtime)
Dbfileparallelread–Happensduringrecoveryorduringbufferprefetchingasanoptimization(8.7%DBtime)
DBCPU–Oracleserver/foreground/shadowprocessCPUconsumption(3.9%DBtime)
145
OraclePerformance&Troubleshooting(cont’d)
q WaitEventHistogramSection(from<1msto>1s)
Showsapercentagetrendatdifferentlatencyvalues
Dbfilesequentialread–RandomI/Osingleblockreadfromdisk
Dbfilescatteredread–AmultiblockreadfromdiskintotheSGA
Dbfileparallelread–Happensduringrecoveryorduringbufferprefetchingasanoptimization
Dbfileparallelwrite–DBWRperformsaparallelwritetofiles
Directpathwrite–AprocessiswritingbuffersdirectlyfromPGAtodisk
146
OraclePerformance&Troubleshooting(cont’d)
q WaitEventHistogramSection(from<32msto>=2s)
147
OracleLicense&Support
148
OracleLicenseModel
NamedUserPlus
- StandardEditionOnerequiresaminimumof5NamedUserorthetotalnumberofactual
users,whicheverisgreater
- StandardEditionrequiresaminimumof5NamedUserorthetotalnumberofactualusers,
whicheverisgreater
- TheEnterpriseEditionrequiresaminimumof25NamedUserPlusperProcessorlicensesor
thetotalnumberofactualusers,whicheverisgreater
Processor–Wewillintroductioninfollowingslide
OraclelicenseswithHardandSoftpartitioningofphysicalsystems
- Hard=“fixed”–allowssubsystemlicensing(Oracle)
- Soft=“fluid”–requiresfullsystemlicensing(Virtualization)
- OraclecountsVMwareasasoft partition technology
- Mustlicense“entireserver”
149
Hard&Softpartition
Hardpartition(UsuallyonHPUX/AIX/Solaris/OracleVM) Softpartition(UsuallyonVMware,HyperV,*OracleVM)
Youjustneedtopayfor4coreslicense
Onenodewith8cores Onenodewith8cores
Youjustneedtopayfor8coreslicense
VM
Using
4vCPU
VM
Using
4vCPU
150
CoreFactorTable
http://www.oracle.com/us/corporate/contracts/processor-core-factor-table-
070634.pdf
151
OracleDatabaseLicensing–
CPUBasedSKUConsiderations
StandardEditionTwo
Licensedbysocket
Limitedtotwo sockets
Mustlicensefullmachine
StandardEdition
Licensedbysocket
Limitedtofour sockets
Mustlicensefullmachine(s)
EnterpriseEdition
Licensedbycore
Applyx86factorof0.5tocores
Mustlicensefullmachine
Ex:3360G4,E52630v3(16core)
5.8Kx2socketx3
hosts=34.8K
17.5Kx2socketx3
hosts=105K
47.5Kx16corex3
hostsx0.5corefactor
=1140K
Oraclehave“NumberofUserlicense“wedonotintroducehere,onecorelicenseabout25nameusers
http://www.oracle.com/us/corporate/pricing/technologypricelist070617.pdf(OraclePriceBook)
152
OracleLicenseonVirtualization
VM
(Oracle)
VM
(Oracle)
VM
(Oracle)
vMotion vMotion
Oracletreatvirtualizationassoftpartition,weneedentitleallthelicenseofphysicalbox
VMcanvMotionbetweenourNutanixCluster,soweneedentitleallthecluster
UsingDRSaffinitytolimitVMvMotionhosts,thatcansaveforOraclelicense
Thoselogs(/var/log/vmware/hostd.log,/vmfs/volumes/datastore/vm/vmware.log)providevMotionandprove
VMrunningonwhichhosts
Whenentitleallboxorcluster,youcanrunasmuchVM(Oracle)asyoucan
153
Choosethefewercoresforsavinglicense
ChoosefewercoresmodelCPUwhenpurchase
CheckifeveryOracleDBneeduseEEedition?DoespossibletoswitchtoSTDEdition?
154
SavingOracleLicense(DRS)
Ifyouhave8nodesNutanixcluster,6nodeswerunVDIsolutionandwejusthavetwonodesthatrunning
OracledatabaseguestVM.Wejustneedpayfortwonodeslicensefee.
Inthistwonodes,youcanrununlimitedOracledatabaseguestVM
VM
(Oracle)
VM
(Oracle)
VM
(Oracle)
VM
(Oracle)
VM
(Oracle)
VM
(Oracle)
Oracleusednodes
VDInodes
NutanixCluster
155
SavingOracleLicense(DifferentESXiClusterbutsame
NutanixNDFS)
ESXiCluster1(forApplications) ESXiCluster2(Oracle)
AHVwillsuggestusedifferentclusterbydatabase
156
SavingOracleLicenseDesign
NX8235G4or
NX3260G4
NX6235C
Oneclustercomposebyfournodes
TwoareComputeNodes,theothertwoareStorageNodes
SowejustpayforthetwoComputeNodeslicenses,because
OracleGuestVMneverrunningonStorageNodes.
VM
(Oracle)
VM
(Oracle)
VM
(Oracle)
VM
(Oracle)
VM
(Oracle)
VM
(Oracle)
VM
(Oracle)
VM
(Oracle)
VM
(Oracle)
157
Maintainsamelicensecostasbefore
Volume Group
Non-disruptive upgrades &
fast fail-over in seconds
I/O load balanced across all nodes
(including new node)
Single-step discovery via data
services IP
New Node
Nutanixjustasastorage
158
Youcandesignlikethis
VM
(Oracle)
VM
(Oracle)
VM
(APP)
VM
(Oracle)
VM
(Oracle)
VM
(APP)
VM
(Oracle)
VM
(Oracle)
VM
(APP)
DedicateforABS
iSCSI
NFS
159
OracleLicensing
160
MarsvsOracle
http://houseofbrick.com/marsvsoracle/
TheMartian’sresponse
161
Oracle support ESXi Document – 249212.1
IfaproblemisaknownOracleissue,Oraclesupport
willrecommendtheappropriatesoutiononthenativeOS.
IfthatsolutiondoesnotworkintheVMwarevirtualized
Environment,thecustomerwillbereferredtoVMware
Forsupport.Whenthecustomercandemonstratethatthe
Oraclesolutiondoesnotworkwhenrunningonthe
nativeOS,Oraclewillresumesupport,includinglogginga
BugwithOracleDevelopmentforinvestigationifrequired.
162
Nutanix TSANET support
https://www.tsanet.org/blog/2015/7/7/tsanet-member-spotlight-%E2%80%93-
nutanix
163
Oracle on AHV support
https://portal.nutanix.com/#page/kbs/details?targetId=kA032000000TTtJCAW
Thank You
165
WhereshouldIgetdiscount?
Thisisarealcase–
Oraclealreadyassume50%discount
WecanseeOracletake60%
ofallprojectbudget
VMwareget23%ofwholeproject
Nutanixjust17%inwholeproject
IfwegetmorediscountfromOracle
Wecansave$$
WealsocaneliminateESXilicence
FeebyusingAHV
166
Ifmydatabasedatamorethanonenode?
FirstIhavetosay,youdidthewrongsizing
Nutanixstillcanfixthisissue
167
NutanixClone
168
NutanixSnapshot
169
CompressioninContainerLevel
Thiswillalsoincreasetheusable
sizeoftheSSDtierincreasing
effectiveperformanceand
allowingmoredatatosit
intheSSDtier.
170
NutanixDataProtection
Advantage
Simple
CansetupmultipleOracleserversbackupinonegroup,donotneedextra
configuration
CanputallDB,RelatedAppServerinsameprotectiondomain
CanintegratedwithVSSifguestOSisWindows
Disadvantage
JustrecovertoPIT
Every60minutesinterval–RPOtoolongforadatabase